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Abstract 

Segmenting an image into multiple components is a central task in computer 
vision. In many practical scenarios, prior knowledge about plausible components 
is available. Incorporating such prior knowledge into models and algorithms for 
image segmentation is highly desirable, yet can be non-trivial. In this work, we 
introduce a new approach that allows, for the first time, to constrain some or all 
components of a segmentation to have convex shapes. Specifically, we extend the 
Minimum Cost Multicut Problem by a class of constraints that enforce convexity. 
To solve instances of this APX-hard integer linear program to optimality, we 
separate the proposed constraints in the branch-and-cut loop of a state-of-the-art 
ILP solver. Results on natural and biological images demonstrate the effectiveness 
of the approach as well as its advantage over the state-of-the-art heuristic. 


1 Introduction 

Image segmentation is a challenging task for which often times the use of suitable prior knowledge 
about the shape of the sought objects plays an important role. One interesting shape prior is 
convexity [9, 10, 7, 6]. In natural images, it often occurs that there are multiple convex structures 
of the same or different classes present in one image, such as wheels or various fruit, as well as 
composite structures constructed from convex parts, such as bricks and floor tiles. Biology similarly 
gives numerous examples of multiple convex structures. For example, many cell types are convex, 
such as bacteria, yeast, and more complicated cells densely packed into tissue. Numerous subcellular 
structures, including nuclei and various types of vesicles, are also convex. Despite the clear relevance 
of this situation to the task of image segmentation, respective priors have, to the best of our knowledge, 
not yet been addressed in the literature. 

Existing methods for segmenting multiple convex structures are specifically designed for certain 
shapes like ellipsoids or rods, as e.g. [5]. Such methods do not enforce generic convexity, but instead 
employ priors of specific shapes that happen to be convex. Furthermore, such methods commonly 
segment multiple structures sequentially, and neither the reconstruction of individual structures nor 
the resulting segmentation of multiple structures is globally optimal w.r.t. the underlying objective. 

Beyond specific shape priors, there has been recent interest in generic convexity priors for binary 
image segmentation. Star convexity priors were introduced in [10], where convexity is defined with 
respect to all rays emanating from a central, user-defined seed point. This approach was generalized 
to the case of Geodesic Star Convexity by [7], which defines convexity with regards to Geodesic 
paths. Truly convex objects were first handled by [9]. However, this approach is limited to a single 
foreground class, which must be explicitly modeled. The task of segmenting convex foreground 
objects without the requirement of user input or explicit modeling is studied in [6]. They propose a 
graphical model with triple-cliques that encode convexity constraints as 1-0-1 label sequences along 
straight lines in the image. This formulation captures the global nature of convexity. However, it 
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Figure 1: Method overview, (a) The Multicut Problem 1 expresses image decomposition as a binary 
edge labeling problem in a pixel grid graph. Components are inferred from the edge labels via 
connectivity analysis, (b) Cycle constraints enforce that edges between pixels in the same component 
cannot be cut. (c) We enrich the Multicut Problem by convexity constraints. Our constraints 
implement the set theoretic definition of convexity on a discrete grid. 


implies that only one connected component of the foreground class can be present. Furthermore, the 
complexity of the problem requires the use of approximate solvers which may lead to local minima. 
None of the above methods is able to segment many generic convex objects of multiple foreground 
classes, fully automatically, without the need for user-defined seed points. 

Contributions. In this work we propose the first model and solver for pixel-level segmentation of 
many generic convex objects of multiple foreground classes. We introduce new models that include 
convexity constraints into multicut problems, which are ILP formulations of image decomposition 
problems. We consider two multicut problems, one equivalent to the correlation clustering prob¬ 
lem [2], another one equivalent to the Potts model. For efficiency, following the idea in [ 8 , 1], we 
iteratively incorporate only the constraints that are violated per instance, and when no more violations 
occur, we are guaranteed the globally optimal solution. To the best of our knowledge, our models are 
the first to handle many convex objects and multiple foreground classes. Our models can be solved to 
global optimality in small yet practical cases. Figure 1 gives an overview of the multicut problems as 
well as our proposed convexity constraints, as described in detail in Sections 2 and 3. 

2 Image Decomposition by Multicuts 

Given the pixel grid graph G = (y, of an image, image segmentation tasks are often modeled 
as the problem of assigning, to each node v e V, one label from a label set L = { 1 ,..., /c} so as 
to minimize some objective function. A widely used objective function is the energy of a pairwise 
conditional random field. A particular instance of this type of objective is the well-known Potts model. 
Its pairwise terms are non-zero only for edges that connect nodes with different labels. A special case 
of the Potts model is the Correlation Clustering or Partitioning model [2] . The respective energy 
neglects unary terms, and the number of labels equals the number of nodes. 

In the following we describe two Multicut Problems. The first one is equivalent to Correlation 
Clustering. The second one is equivalent to the Potts model. We also discuss respective solvers 
as proposed in [ 8 , 1]. These Multicut Problems are ILPs that form the basis of our contribution: 
In Section 3 we take the set theoretic definition of convexity of the connected components of a 
segmentation, and directly translate it into inequality constraints that we add to the respective ILPs. 

The Minimum Cost Multicut Problem. The minimum cost multicut problem [4] is equivalent 
to the correlation clustering problem. Its feasible solutions are all decompositions of the graph G. 
A decomposition of G is a partition UofV such that, for every G G 11, the subgraph of G induced 
by U is connected. A subgraph of G that is connected and induced by a node set G CV is called a 
component of G. Any decomposition 11 of G is characterized by the subset of edges that straddle 
distinct components: En = {vw G E \ \fU \ v ^ U M w ^ U}. Such a subset of edges is called 
a multicut of G. There is exactly one multicut related to each decomposition of G. The following 
Theorem forms the basis of multicut problems: 

Theorem 1 The multicuts of G are precisely the subsets Y C E for which every cycle G Q E in G 
satisfies |G fl F| 7 ^ 1 . 
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This has been proven in [4]. We give the proof in the Appendix. For a sketch, see Figure lb. 

Let y G {0,1}^ be a 01-encoding of a multicut Y. It makes explicit, for any pair uv ^ E oi 
neighboring nodes, whether u and v are in distinct components, namely iff yuv = 1.^ These edge 
labels ye allow for an equivalent formulation of |C fl F| ^ 1 as linear inequality constraints (2), 
which leads to the following Definition: 

Definition 1 [4] Given a finite, simple, non-empty graph G = {V^E) and a map c \ E (that 
is, for any pair vw ^ E of neighboring nodes, a cost or reward for ^ and w being in distinct 
components), the instance of the Minimum Cost Multicut Problem (MC) with respect to G and c is 
the ILP 


min 

subject to 


^ ^ ^eVe 
eeE 

VC G cycles(G) Ve G C : ye < 

e'ec\{e} 


( 1 ) 

( 2 ) 


Constraints (2) are referred to as as cycle constraints. It is sufficient to consider only the chordless 
cycles of G [4] . 


The Minimum Cost Multicut Problem with Node Labels. We also consider a Multicut Problem 
that is equivalent to the Potts model. This is a more constrained optimization problem in which 
every node assumes precisely one out of finitely many labels, and neighboring nodes are in the same 
component iff they have the same label: 

Definition 2 Given a finite, simple, non-empty graph G = {V,E),Si map c : C ^ M, a finite set 
L ^ 9 and a map d : V x L (that is, for any node v and any label /, a cost or reward dyi for v 
being labeled /), the instance of the Minimum Cost Multicut Problem with Node Labels (MCN) with 
respect to G, L, c and d is the ILP 


min 

^ ^ ^eVe V ^ ^ ^ ^ dylXyl 

cClE vGV IClL 

(3) 

subject to 

ev \ 1 < Y^ieL^yi 

(4) 


\/V G Vy{l^l'} G ( 2 ) • Xyl Xyl' < 1 

(5) 


^VW G E } G ^ 2 ) • Xyl “h Xyjl' 1 ^ yvw 

(6) 


^VW G E V/ G L . yvw — Xyl Xyjl 

(7) 


Here, any feasible solution (x, y) is constrained such that every node v is assigned at least and at 
most one label, namely the unique I G L such that Xyi = 1, by (4) and (5). It is also constrained such 
that, for any edge vw G E, yyyj = 1 if and only if v and w have distinct labels, by (6) and (7). Thus, 
y is the characteristic function of a multicut of G. It defines uniquely a decomposition of G. 

Solvers. Branch-and-cut algorithms for Problem 1 are proposed in [8, 1]. They find globally 
optimal solutions in reasonable run-time in many practical cases by including constraints (2) per 
instance of the problem only in case they are violated. Problem 2 is solved by [8] by transforming 
it into an equivalent Minimum Cost Multicut Problem on a modified graph. This transformation 
involves flipping the meaning of node label variables resulting in the so-called multiway cut problem. 


3 Method 

This Section provides the methodological contribution of our work. In Section 3.1, we propose a 
model for image decomposition under the constraint that each component of the resulting partition 
has to be convex. We achieve this via additional inequality constraints that we include into the 
Minimum Cost Multicut Problem 1. Furthermore, we propose a respective model with node labels. 

^Note that in [4] the interpretation of the 01-encoding is flipped, i.e. = 0 means that an edge is an element 
of the multicut. 
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Components 

Path P whose hull is the dark grey component 

Bresenham's straight line does not form a valid convexity constraint, 

because it crosses the boundary of the convex component 

The straight line S(P) within the hull of path P forms a valid convexity constraint. 


Figure 2: Discrete convexity in image grid graphs. 


With this model, we can enforce for any pair of labels, {kj} G that a component of label k 
does not contain any node labeled I in its convex hull. This is more general than “simply” enforcing 
convexity of components. We achieve this, again, via inequality constraints that we include into the 
Minimum Cost Multicut Problem with Node Labels 2. In Section 3.2 we propose a solver for the 
above optimization problems. 


3.1 Convexity Constraints for Image Decomposition 


Let P C E denote an arbitrary open path inG = (V^E). All components of an image decomposition 
n are convex iff for any path P that does not contain any edges in E’n, the straight line between the 
end points of P also does not contain any edges in Eu- We discretize this set theoretic definition of 
convexity as follows: In a pixel grid graph with the usual embedding into the 2d plane, where pixels 
are Voronoi regions of graph nodes (cf. Fig. la), a component is discrete convex iff for every path 
P that does not contain any edges in Eu, the interior of the loop formed by P and the straight line 
between its end points does not enclose any nodes of a distinct component. See Figure 2 for a sketch. 
We call the set of nodes enclosed by this loop the hull of P. Let S{P) denote the path in G that runs 
along the boundary of the discrete hull of P and connects the first and the last node covered by P (cf. 
Fig. 2). All components of an image partition are discrete convex iff 

VP e paths(G) : ^ j/e = 0 ^ y] 2/e = 0. (8) 

eeP eeSiP) 


For a sketch, see Figure Ic. Note that in general, the Bresenham line [3] is different from S{P), as 
sketched in Figure 2. We propose to formulate (8) as linear inequality constraints, which enables us 
to formulate the task of finding the optimal decomposition of G into convex components as an ILP: 
Definition 3 Given a finite, simple, non-empty graph G = (V^E) and a map c : P ^ M, the instance 
of the Minimum Cost Convex Component Multicut Problem (Convex-MC) with respect to G and c is 
the ILP 


min > CePe subject to (2) 


(9) 


and VPepaths(G): |P(P)| ■ 2/e > 2/e (10) 

eGP eeS'(P) 


We also refer to this model as correlation clustering with convexity constraints, to put it into well- 
known terminology. 

Lemma 1 Constraints (10) are equivalent to (8). 


A proof of Lemma 1 is given in the Appendix. 

Now we consider image decomposition with node labels, which is equivalent to the Potts model 
(cf. Section 2). Let Vp denote the nodes covered by a path P, and Vs(p) the nodes covered by the 
respective straight line S{P) but not by P (i.e., all but the “end points” of S{P)). Given an image 
decomposition with node labels x, all components assigned to label k are convex iff 

VP : ^ Xyk = \Vp\ => ^ Xyk = \Vs{P)\‘ (11) 

vCiVp '^ClVs(^p) 

More generally, components assigned to label k have in their convex hulls only nodes with labels 
from a subset of c L (where k ^ L^) iff 

VP : Xyk = |l^p| ^ Xyl = \Vs(P)\. 

veVp veVs(P), 
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This holds because (5) entails Xyk = 1 ^ ~ Constraints (11) are a special case of 

(12), namely with = {k}. We propose to formulate (12) as linear inequality constraints and hence 
yield an ILP that models image decomposition, with node labels, into convex components: 

Definition 4 Given a finite, simple, non-empty graph G = (V^E), a. map c : E ^ R, a finite set 
L 7 ^ 0, a map d : V x L R, and a set Lk E L for each k e L with k e Lk, the instance of the 
Minimum Cost Convex Component Multicut Problem with Node Labels (Convex-MCN) with respect 
to G, L, c, d, and {L^ : k e L} is the ILP 


min 

E 

eSE 

CeVe + E E subject to (4), (5), ( 6 ), (7) 

vev leL 

/ \ 

(13) 

and 

VP; 

Vs(P) • ( \ W\ - L] J > VsCP) - E 

(14) 


vCiVp / vClVs{p)^ 

l^Lk 


We also refer to this model as Potts model with convexity constraints, to put it into well-known 
terminology. The proof of equivalence between the convexity constraints (12) and (14) works 
analogously to the proof of Lemma 1 that we give in the Appendix. 

3.2 Optimization 

Similar to [ 8 , 1] we pursue a cutting plane approach in which violated cycle- and convexity constraints 
are separated and added incrementally. Our algorithm starts by solving MC (see Def. 1) or MCN 
(see Def. 2) with the method described in [ 8 ]. Given the resulting image decomposition, we solve the 
Separation Problem w.r.t. convexity constraints as described below. However, solving an ILP with 
added convexity constraints can entail new violations of cycle constraints. Hence we propose the 
algorithm defined in Figure 3. Upon termination, the algorithm gives the globally optimal feasible 
solution. In practice we can, optionally, allow for ILPs to be solved up to some relative gap of e%. In 
this case our algorithm gives a feasible solution whose energy is at most eiast% away from the global 
optimum, where eiast% is the gap obtained in the last iteration, i.e. directly before termination. 



Figure 3: Our proposed solver for our Convex Component Multicut Problems (Definitions 3 and 4). 


Separation of Convexity Constraints. Given an image decomposition, assuming a 2D pixel grid, 
we detect violated convexity constraints by scanning along sequences of nodes, {ui,..., each 
defined by a start node vi = (x, y) and an offset (a, b), with a, 6 G N co-prime. In case of the 
Convex-MC problem 3, convexity is violated iff two nodes Vj along a sequence lie in the same 
component, and there exists a node Vz in the sequence with i < z < j such that Vz lies in a different 
component. In case of the Convex-MCN problem 4, there is a violation of (generalized) convexity iff 
Vi^ Vj lie in the same component, labeled k, and there exists a node Vz with i < z < j such that Vz is 
labeled I ^ L^. 

The cardinality of the set of orientations of sequences, A := {(u,6) co-prime, — Nx < a < 
Nx^Ny < b < Ny}, is bounded by 0{N‘^), where N = Nx ' Ny denotes the number of pixels 
in a 2d image. Scanning for violations along a particular sequence can be done greedily. For 
each orientation, the union of the sets of sequences to consider covers the whole image. Hence 
the computational complexity for processing one particular orientation is in O(A^). Overall, the 
computational complexity of scanning for violations is bounded by 0{N^). Optionally, one may 
want to consider only a subset of orientations, A C A. Then the effort reduces to 0(| A| • N). 
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Given a pair of nodes {vi , Vj ) that constitutes a violation of convexity, we need to find a respective 
path P and straight line S{P). As for a path P from Vi to Vj through their component: In general 
there are many such paths. To form a constraint, we pick just one such path. We explore two 
variants: In case of Convex-MC (see Def. 3), a shortest path in terms of number of edges; In case of 
Convex-MCN (see Def. 4), a cheapest path in terms of unaries of the label assigned to the component. 
Dijkstra’s algorithm yields an optimal path for either variant. 

We compute the straight line S{P) as follows: (1) Determine the orientation of the loop formed 
by path P and the (continuous) straight line Vi , Vj . (2) Infer the direction of the normal on the 
(continuous) straight line Vi^ Vj that points to the interior of this loop. Without loss of generality, we 
assume that P and the continuous straight line do not intersect. (3) Greedily find the discrete shortest 
path with minimal distance of nodes to the continuous straight line, subject to the constraint that no 
node lies outside the loop. 

4 Results and Discussion 

We present proof-of-concept results of our method on various photographs and biological images. 
For each exemplary image, in addition to the result of our method, we also show the respective result 
obtained without convexity constraints. Finally, we provide a comparison to state of the art [6] on two 
exemplary images. We employ a four-connected grid graph in all experiments. If not noted otherwise, 
we check violations of convexity in 8 discrete directions, and set the stopping criterion for the ILP 
solver to 2%. This is not a hard stopping criterion, and hence smaller gaps are achieved per instance. 
Table 1 lists the gaps, number of iterations, run-times, and energies obtained for each of the examples. 

Potts Model. Figure 4 shows examples to which we apply two-label Potts models enriched by 
convexity constraints on the foreground label by means of the Convex-MCN problem 4. Figure 4(a) 
shows a biological image of ellipsoidal cell nuclei in the tissue of a nematode worm. The image 
shows four whole nuclei, and a fraction of a fifth one at the bottom. Convexity constraints allow for 
a perfect segmentation of the nuclei. In contrast, a Potts model without convexity constraints fails 
to split apart the nuclei, and yields holes within components. Figure 4(d) shows a biological image 
of polygonal cells in a fly wing. Again, convexity constraints allow for a perfect segmentation of 
the nuclei, while a respective Potts model without convexity constraints is not able to correctly split 
apart the cells. Figure 5(a) shows a photograph to which we apply a three-label Potts model with 
convexity constraints on one foreground label. Our method is able to accurately segment two convex 
foreground objects on top of a second, non-convex foreground label. 

Results in Figures 4 and 5(c) were achieved with “simple” convexity constraints as captured by (11). 
An example for the more general constraints (12) is given in Figure 5(d-f). Here, we enforce 
components labeled “apple” to be convex as such, while we enforce components labeled “orange” 
to be convex only w.r.t. the background. In other words, we allow concavities in orange-labeled 
components as long as they are filled exclusively by apple-labeled nodes. Consequently such 
concavities appear as desired. However, incorrect spurious apple components also appear within 
orange components. This result is interesting despite the fact that our model does not achieve a 
perfect segmentation, because it shows potential implications of the generalized constraints. 

Correlation Clustering. Figure 6 shows two exemplary results for correlation clustering enriched 
by convexity constraints by means of the Convex-MC problem 3. In both examples, densely packed 
objects, namely bricks in a stone wall and cells in a fly wing, are nicely separated due to convexity 
constraints. At the same time, the space between these objects is tesselated into convex components. 
Although these results might not be of direct use as segmentations of the respective objects, they may 
well serve as convex supervoxelizations to be used as input for further processing. 

Comparison to State-Of-The-Art on Two Exemplary Images. We compare our method to the 
state-of-the-art for segmentation with convexity constraints [6] . The method of Gorelick et al. [6] is 
able to handle only one convex structure of one foreground label, and we chose exemplary images 
accordingly (Figure 7). We use the code provided by the authors. First we study a synthetic image 
(Figure 7 top). The method of [6] initializes via the Graph Cuts solution, yielding a hole in the 
foreground object. In the process of resolving this high energy configuration, the method breaks the 
outer boundary of the object and settles to a sub-optimal solution. In contrast, our method is able to 
obtain the globally optimal solution. On a second, biological image (Figure 7 bottom), we ran [6] 
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(a) (b) (c) (d) (e) (f) 


Figure 4: Examples for convexity constraints in a two-label Potts model: Excerpts of microscopic 
images of (a) cell nuclei of a nematode worm, and (d) densely packed cells in a fly wing, (b/e) Two- 
label Potts model, (c/f) Convexity constraints on foreground label of the respective Potts model. Note 
that for the nuclei we check violations of convexity in all discrete directions. 



(a) (b) (c) (d) (e) (f) 


Figure 5: Examples for convexity constraints in three-label Potts models, (a) Photograph of two fried 
eggs in a pan (by Matthew Hurst on flickr, CC BY-SA 2.0). (b) Three-label Potts model, (c) Convexity 
constraints on yolk label of the same three-label Potts model, (d) Image of an apple occluding an 
orange, (e) Three-label Potts model, (f) Generalized convexity constraints, with Lappie = {apple} 
and Lorange = {apple^ orange}. Thus the apple label cannot have anything but apple in it’s convex 
hull, while the orange label is allowed to have apple in it’s convex hull, but not background. 



Figure 6: Examples for convexity constraints in correlation clustering models: (a) Natural image of 
a stone wall, (d) Densely packed cells in excerpt of microscopic image of fly wing. (Same image 
as in Eigure 4(d).) (b/e) Correlation clustering model, (c/f) Convexity constraints in the respective 
correlation clustering model. 


Experiment 

Res 

E 

ConvexE 

# Iter 

Time 

Gap 

Nuclei, 2 label Potts 

48x48 

725 

770 

9 

15 sec 

0.05 % 

Fly wing, 2 label Potts 

101x101 

1089 

1240 

11 

380 sec 

2% 

Fried eggs, 3 label Potts 

163x137 

64633 

64567 

22 

166 sec 

0.04 % 

Synthetic, 3 label Potts 

155x104 

3275 

3529 

1 

2 sec 

0% 

Apple and orange, 3 label Potts 

200x165 

40390 

40428 

158 

870 sec 

0.06 % 

Stone wall, correlation clustering 

101x101 

-226 

-188 

33 

10519 sec 

1.5 % 

Fly wing, correlation clustering 

101x101 

-419 

-394 

14 

251 sec 

1 % 


Table 1: Eor each experiment, we list the image resolution in pixels (Res), the energy of the solution 
obtained without convexity constraints (E), the energy of the solution obtained with convexity 
constraints (ConvexE), the number of times that convexity constraints are iteratively added to the ILP 
(# Iter), the run-time of the algorithm with convexity constraints (Time), and the gap achieved in the 
flnal iteration (Gap). 


7 

















Energy = 3894 I Energy = 3877 



Figure 7: Comparison of our method to the state-of-the-art method of Gorelick et al. [ 6 ] on a 
synthetic and a biological image. Top row: (a) Synthetic image, (b) Optimal solution of a Potts 
model. (c,d) Method [ 6 ], initialized by (b). (c) First iteration, and (d) sixth iteration (converged), with 
energy, (e) Our method obtains the globally optimal convex solution. Bottom: (a) Biological image 
(cf. Fig. 4a). (b) Optimal solution of a Potts model, (c) Solution of method [ 6 ], initialised by (b), and 
(d) initialized by a square manually placed around the sought structure (top right small image). Both 
solutions of [ 6 ] are sub-optimal, (e) Our method yields a globally optimal convex solution. 


with two different initializations, namely the standard Graph Cut solution, as well as a box that we 
manually placed around the sought structure. Both initializations result in sub-optimal solutions, 
whereas our method is again able to obtain a globally optimal solution. However, we note that the 
method of [ 6 ] is considerably faster than ours. 

5 Conclusion and Future Work 

We proposed a new approach that introduces convexity constraints into two multicut problems that 
are equivalent to Correlation Clustering and the Potts Model, respectively. Our approach handles 
convexity constraints for many connected components of multiple different classes, and additionally 
for pre-specified convexity relationships between objects of different classes. All concepts described 
in this paper extend in a straightforward way to 3D. In future work we will explore strategies for 
improving the run-time, e.g. via warm-start of subsequent ILPs, for the application to larger data. 

Appendix 

Proof of Theorem 1. First we show that every multicut satisfies \C D Eu\ ^ 1 for all cycles. 
Given a decomposition and related multicut Eu, assume there exists a cycle C with C fl Eu = {uv}. 
Then uv straddles distinct components because uv G Eu- On the other hand, the path C \ {uv} 
connects u and v with edges that are not in Eu, and hence u and v belong to the same component. By 
contradiction, this proves that \C fl Eu | 7 ^ 1 for all cycles. Second we show that every Y that satisfies 
|C n F| 7 ^ 1 for all cycles is a multicut of G. Given such a Y, we construct a decomposition H and 
related multicut Eu of G as follows: uv ^ Eu there exists a path P between u and v such that 
P OY = 0. Now we show that Y = Eu- If uv ^ Y, then uv ^ Eu, because there is a path between 
u and V such that PDF = 0, namely P = {uv}. If uv ^ Eu, assume uv G Y. Then, because 
uv ^ Eu, there exists a path between u and v such that P DY = 0. Hence the cycle G := PU {uv} 
satisfies |(7 fl F| = 1. By contradicting uv G F, this proves that if uv ^ Eu, then uv ^ F. 

Proof of Lemma 1. Given a path P. In case XleeP = 0 it follows from ye > 0 that (10) 
4=> Y2ees(P) ^ 0 4=> Y2ees(p) Ve — ^ ^ ( 8 ). Case Ve 7 ^ 0 entails ^ 1 because 

Ve G {0,1}. Hence |P(P)| • f^eepy^ - l^(^)l' > Eees(P) because ^g < 1. So, 

true (10) (8). 
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